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Abstract 

We study both analytically and numerically the ef- 
fect of presynaptic noise on the transmission of in- 
formation in attractor neural networks. The noise 
occurs on a very short-time scale compared to that 
for the neuron dynamics and it produces short- 
time synaptic depression. This is inspired in recent 
neurobiological findings that show that synaptic 
strength may either increase or decrease on a short- 
time scale depending on presynaptic activity. We 
thus describe a mechanism by which fast presynap- 
tic noise enhances the neural network sensitivity to 
an external stimulus. The reason for this is that, 
in general, the presynaptic noise induces nonequi- 
librium behavior and, consequently, the space of 
fixed points is qualitatively modified in such a way 
that the system can easily scape from the attrac- 
tor. As a result, the model shows, in addition to 
pattern recognition, class identification and catego- 
rization, which may be relevant to the understand- 
ing of some of the brain complex tasks. 



1 Introduction 



There is multiple 
|Abbott and Regehr 



converging evidence 
2004| that synapses de- 



termine the complex processing of information in 



the brain. An aspect of this statement is illustrated 
by attractor neural networks. These show that 
synapses can efficiently store patterns that are af- 
terwards retrieved with only partial information on 
them. In addition to this long-time effect, artificial 
neural networks should contain some "synaptic 
noise", however. That is, actual synapses exhibit 
short-time fluctuations, which seem to compete 
with other mechanisms during the transmission 
of information, not to cause unreliability but to 
ultimately determine a variety of computations 
[Alien and Stevens, 1994| |Zador, 1998| . In spite 
of some recent efforts, a full understanding of 
how the brain complex processes depend on such 
fast synaptic variations is lacking — see below 
and [Abbott and Regehr, 2004| , for instance — . 
A specific matter under discussion concerns the 
influence of short-time noise on the fixed points 
and other details of the retrieval processes in 
attractor neural networks [Bibitchkov et al., 2002| . 

The observation that actual synapses endure 
short-time depression and/or facilitation is likely 
to be relevant in this context. That is, one 
may understand some observations by assuming 
that periods of elevated presynaptic activity may 
cause either decrease or increase of the neuro- 
transmitter release and, consequently, that the 
postsynaptic response will be either depressed or 
facilitated depending on presynaptic neural ac- 
tivity 'Tsodyks et al., 1998, Thoms on et al., 2002[ 
[Abbott and Regehr, 2004 . Motivated by the neu- 
robiological flndings, we report in this paper on ef- 
fects of presynaptic depressing noise on the func- 
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tionality of a neural circuit. We study in detail a 
network in which the neural activity evolves at ran- 
dom in time regulated by a "temperature" param- 
eter. In addition, the values assigned to the synap- 
tic intensities by a learning (e.g., Hebb's) rule are 
constantly perturbed with microscopic fast noise. 
A new parameter is involved by this perturbation 
that allows for a continuum transition from depres- 
sion to normal operation. 

As a main result, this paper illustrates that, 
in general, the addition of fast synaptic noise in- 
duces a nonequilibrium condition. That is, our 
systems cannot asymptotically reach equilibrium 
but tend to nonequilibrium steady states whose 
features depend, even qualitatively, on dynamics 
[Marro and Dickman, 19 99 . This is interesting be- 
cause, in practice, thermodynamic equilibrium is 
rare in nature. Instead, the simplest conditions 
one observes are characterized by a steady flux of 
energy or information, for instance. This makes 
the model mathematically involved, e.g., there is 
no general framework such as the powerful (equi- 
librium) Gibbs theory, which only applies to sys- 
tems with a single Kelvin temperature and a unique 
Hamiltonian. However, our system still admits ana- 
lytical treatment for some choices of its parameters 
and, in other cases, we discovered the more intri- 
cate model behavior by a series of computer simula- 
tions. We thus show that fast presynaptic depress- 
ing noise during external stimulation may induce 
the system to scape from the attractor, namely, 
the stability of fixed point solutions is dramatically 
modified. More specifically, we show that, for cer- 
tain versions of the system, the solution destabi- 
lizes in such a way that computational tasks such as 
class identification and categorization are favored. 
It is likely this is the first time such a behavior is 
reported in an artificial neural network as a con- 
sequence of biologically-motivated stochastic be- 
havior of synapses. Similar instabilities have been 
reported to occur in monkeys |Abe les et al ., 1995| 
and other animals [Miller and SchremerTsOOOl , and 
they are believed to be a main feature in odor en- 
coding [Laurent et al., 2001] , for instance. 

2 Definition of model 

Our interest is in a neural network in which 
a local stochastic dynamics is constantly influ- 



enced by presynaptic noise. Consider a set 
of N binary neurons with conflgurations S = 
{si = ±1; « = 1, . . . , iV} . ^ Any two neurons are 
connected by synapses of intensity: ^ 

Wij = WijXj Vi, j. (1) 

Here, Wij is fixed, namely, determined in a pre- 
vious learning process, and OCj IS Si stochastic 
variable. This generalizes the hypothesis in previ- 
ous studies of attractor neural networks with noisy 
synapses; see, for instance, JSompolinsky, 1986| 
[Garrido and Marro, 199"T1 [Marro et alT7l999r 
Once W ={wij} is given, the state of the system 
at time t is defined by setting S and X = {xi}. 
These evolve with time — after the learning process 
which fixes W — via the familiar Master Equation, 
namely, 

= -P,(S, X) / 5: c[(S, X) ^ (S', X')] 

+ / ^c[(S',X')-(S,X)]P,(S',X'). (2) 

We further assume that the transition rate or prob- 
ability per unit time of evolving from (S, X) to 
(S',X') is 

c[(S, X) ^ (S', X')] = pc^[S ^ S']S{X - X') 

+ (l-p)c«[X^X']<5s.s'. (3) 

This choice [Garrido and Marro, 1994| 

[Torres et al., 1997| amounts to consider com- 
peting mechanisms. That is, neurons (S) evolve 
stochastically in time under a noisy dynamics 
of synapses (X), the latter evolving (1 — p)/p 
times faster than the former. Depending on the 
value of p, three main classes may be defined 
[Marro and Dickman, 1999| : 

1. For p G (0, 1) both the synaptic fluctua- 
tion and the neuron activity occur on the 

^Note that such binary neurons, although a crude sim- 
phfication of nature, are known to capture the essentials of 
cooperative phenomena, which is the focus here. See, for 
instance [Abbott and Kepler, 1990||Pantic et al., 2002] . 

^For simplicity, we are neglecting here postsynaptic de- 
pendence of the stochastic perturbation. There is some 
claim that plasticity might operate on rapid time-scales 
on postsynaptic activity; see [Pitler and Alger, 1992] , How- 
ever, including Xij in Q instead of xj would impede some 
of the algebra in sections 1^ and El 
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same temporal scale. This case has already 
been preliminary explored [Pantic et al., 2002| 
[Cortes et al, 2004| . 

2. The limiting case p ^ 1. This corresponds to 
neurons evolving in the presence of a quenched 
synaptic configuration, i.e., Xi is constant 
and independent of i. The Hopfield model 
lAmari, 19 72 Hopfiel d, 1982| belongs to this 
class in the simple case that Xj = l,Vj'. 

3. The limiting case p ^ 0. The rest of this paper 
is devoted to this class of systems. 

Our interest for the latter case is a consequence of 
the following facts. Firstly, there is adiabatic elim- 
ination of fast variables for p ^ which decou- 
ples the two dynamics [Garrido and Marro, 1994| 
[Gardiner, 2004'i . Therefore, some exact analytical 
treatment — though not the complete solution — is 
then feasible. To be more specific, for p ^ 0, the 
neurons evolve as in the presence of a steady distri- 
bution for X. If we write P(S, X) = P(X|S) P(S), 
where P(X|S) stands for the conditional probabil- 
ity of X given S, one obtains from (0 and Q, 
after rescaling time tp —f t (technical details are 
worked out in [Marro and Dickman, 199'9l , for in- 
stance) that 



+ ^c[S'-S]P,(S') 



Here, 



3[S^S'] = ydXP'^*(X|S)c^[S -> S'], 



(4) 



(5) 



and P^'(X|S) is the stationary solution that satis- 
fies 

^ ^^^^> ^ /dX'cS[X^ X'] • 

This formalism will allows us for modelling fast 
synaptic noise which, within the appropiate con- 
text, will induce sort of synaptic depression, as ex- 
plained in detail in sectional 

The superposition (jSJ reflects the fact that ac- 
tivity is the result of competition between differ- 
ent elementary mechanisms. That is, different un- 
derlying dynamics, each associated to a different 



realization of the stochasticity X, compete and, 
in the limit p ^ 0, an effective rate results from 
combining c^[S S'] with probability P"*(X|S) 
for varying X. Each of the elementary dynamics 
tends to drive the system to a well-defined equi- 
librium state. The competition will, however, im- 
pede equilibrium and, in general, the system will 
asymptotically go towards a nonequilibrium steady 
state [Marro and Dickman, 199'9| . The question is 
if such a competition between synaptic noise and 
neural activity, which induces nonequilibrium, is at 
the origin of some of the computational strategies 
in ncurobiological systems. Our study below seems 
to indicate that this is a sensible issue. As a matter 
of fact, we shall argue below that p — > may be re- 
alistic a priori for appropriate choices of P*'*(X|S). 

For the sake of simplicity, we shall be concerned 
in this paper with sequential updating by means 
of single neuron or "spin-fiip" dynamics. That is, 
the elementary dynamic step will simply consist of 
local inversions Si —Si induced by a bath at tem- 
perature T. The elementary rate c^[S S'] then 
reduces to a single site rate that one may write as 
^[u ^(S, i)]. Here, u^(S, i) = 2T~^Sihf{S), where 
hf'{S) — the net presynaptic cur- 

rent arriving to — or local field acting on — the 
(postsynaptic) neuron i. The function \l/(u) is ar- 
bitrary except that, for simplicity, we shall assume 
^(n) = exp{-u)^{-u), ^( 0) = 1 and ^'(oo) = 
[Marro and Dickman, 199'9| . We shall report on 
the consequences of more complex dynamics in a 
forthcomming paper [Cortes et al., 2005| . 

3 Effective local fields 

Let us define a function iJ°*(S) through the con- 
dition of detailed balance, namely. 



z[S' S] 



= exp {- [H'^^iS') - H^^iS)] T-i} 



(7) 

Here, S* stands for S after hipping at i, Si —> — s^. 
We further define the "effective local fields" /i°^(S) 
by means of 



^°^S) = -i^/if(S)s,. 



(8) 



Nothing guaranties that H'^^{S) and h°^{S) have 
a simple expression and are therefore analytically 
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useful. This is because the superposition un- 
Uke its elements -^), does not satisfy detailed 
balance, in general. In other words, our system has 
an essential nonequilibrium character that prevents 
one from using Gibbs's statistical mechanics, which 
requires a unique Hamiltonian. Instead, there is 
here one energy associated with each realization of 
X ={xi}. This is in addition to the fact that the 
synaptic weights Wij in |^ may not be symmetric. 

For some choices of both the rate 4' and 
the noise distribution P''*(X|S), the function 
H^^{S) may be considered as a true effec- 
tive Hamiltonian [ Garrido and Marro, 19891 
[Marro and Dickman, 1999| . This means that 
iJ®'*(S) then generates the same nonequilibrium 
steady state than the stochastic time-evolution 
equation which defines the system, i.e., equation 
Q, and that its coefficients have the proper 
symmetry of interactions. To be more explicit, 
assume that P'^*(X|S) factorizes according to 



with 



p^* (xis)=n^(^^>j)' 



(9) 



and that one also has the factorization 



c[S dxj P{xj\sj) <i'{2T-'^s,WijXjSj). 

(10) 

The former amounts to neglect some global de- 
pendence of the factors on S ={si} (see below), 
and the latter restricts the possible choices for 
the rate function. Some familiar choices for this 
function that satisfy detailed balance are: the 
one corresponding to the Metropolis algorithm, 
i.e., '^{u) = min[l, exp(— u)]; the Glauber case 
^/[u) = [1 + exp(M)]~^; an d 4'(m) = exp(-u/2) 
IMarro and Dickman, 19991 . The latter fulfills 
^{u + v) = ^'(u)5'(w) which is required by H1U|) 
^. It then ensues after some algebra that 



±^1 c(A,;+)c(±A,-;-) 
"^^■-4 c(-A,;T)c(T/3y;±)' 



where f3ij = 2T ^Wij, and 



(12) 



c(Aj; Sj) = J dxj P{xj\sj) ^{P^jXj). (13) 

This generalizes a case in the litera- 
ture for random S -independent fluc- 
tuations IGarrido and Munoz, 1993| 



Lacomba and Marro, 1994] 
^a^^m^^icnnan^^99[ 

has c(±k; +) = c(±k; - 



In this case, one 
) and, consequently. 



a^j — Vi, J. However, we here are concerned with 
the case of S-dependent disorder, which results in 
a non-zero threshold, 9i = ^j^i a~j ^ 0. 

In order to obtain a true effective Hamiltonian, 
the coefficients in Hll|l need to be symmetric. 
Once \['(m) is fixed, this depends on the choice for 
P(xj\sj)^ i.e., on the fast noise details. This is stud- 
ied in the next section. Meanwhile, we remark that 
the effective local fields defined above are very 
useful in practice. That is, they may be computed 
— at least numerically — for any rate and noise dis- 
tribution. As far as ^'(u + v) ^ '^{u)'^{v) and 
P"^' (X|S) factorizes,^ it follows an effective transi- 
tion rate as 



c[S ^ S'] = exp {~s,hf/T) 



(14) 



This effective rate may then be used in computer 
simulation, and it may also serve to be substituted 
in the relevant equations. Consider, for instance, 
the overlaps defined as the product of the current 
state with one of the stored patterns: 



m''(S) 



(15) 



(11) 



^In any case, the rate needs to be properly normalized. 
In computer simulations, it is customary to divide >I'(n) by 
its maximum value. Therefore, the normalization happens 
to depend on temperature and on the number of stored pat- 
terns. It follows that this normalization is irrelevant for the 
properties of the steady state, namely, it just rescales the 
time scale. 



Here, = {^f = ±l,i = 1,...,N} are M 
random patterns previously stored in the system, 
1/ = 1, . . . ,M. After using standard techniques 
[Hertz et al., 1991) [Marro and Dickman, 1999| ; see 



''The factorization here does not need to be in 
products P {xj\sj) as in 0. The same result H14|l 
holds for the choice that we shall introduce in the 
next section, for instance. 
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also |Amit et al., 1987| , it follows from igj that 
dtm'' = 2N-^ er sinh (ftf /T)-s, cosh {hf /T) . 

(16) 

which is to be averaged over both thermal noise and 
pattern realizations. Alternatively, one might per- 
haps obtain dynamic equations of type (|16|l by us- 
ing Fokker-Planck like formalisms as, for instance, 
in [Brunei and Hakim, 1999| . 

4 Types of synaptic noise 

The above discussion and, in particular, equations 
and H12(l . suggest that the system emergent 
properties will importantly depend on the details of 
the synaptic noise X. We now work out the equa- 
tions in section|31for different hypothesis concerning 
the stationary distribution 

Consider first with the following specific 
choice: 

P{^^ ) = ^^4^ 5{x, + $) + i^il^ 5{x, - 1). 

(17) 

This corresponds to a simplification of the stochas- 
tic variable Xj. That is, for Fj = 1 Vj, the noise 
modifies Wij by a factor — $ when the presynaptic 
neuron is firing, Sj = 1, while the learned synap- 
tic intensity remains unchanged when the neuron 
is silent. In general, Wij = — with probability 
\ {\ + SjFj). Here, Fj stands for some informa- 
tion concerning the presynaptic site j such as, for 
instance, a local threshold or Fj — M'^ Tl^^'j ■ 

Our interest for case (|17|l is two fold, namely, 
it corresponds to an exceptionally simple situation 
and it reduces our model to two known cases. This 
becomes evident by looking at the resulting local 
fields: 

hf^\Y. - '1 - (1 + Fj\ ■ (18) 

That is, exceptionally, symmetries here are such 
that the system is described by a true effective 
Hamiltonian. Furthermore, this corresponds to the 
Hopficld model, except for a rescaling of temper- 
ature and for the emergence of a threshold 9i = 
^jUJijFj [Hertz et al., 199P. On the other hand, 
it also follows that, concerning stationary prop- 
erties, the resulting effective Hamiltonian re- 
produces the model as in [Bibitchkov et al., 2002] . 



In fact, this would correspond in our notation to 

^i*^ — ^J2j^i^ij^j^T ' where a:°° stands for the 
stationary solution of certain dynamic equation for 
Xj . The conclusion is that (except perhaps concern- 
ing dynamics, which is something worth to be in- 
vestigated) the fast noise according to © with H17|) 
does not imply any surprising behavior. In any 
case, this choice of noise illustrates the utility of 
the effective-field concept as defined above. 

Our interest here is in modeling the noise consis- 
tent with the observation of short-time synaptic de- 
pression [Tsodyks et al., 1998[ [Pantic et al., 2002[ . 
In fact, the case (jlVI) in some way mimics that in- 
creasing the mean firing rate results in decreasing 
the synaptic weight. With the same motivation, a 
more intriguing behavior ensues by assuming, in- 
stead of ©, the factorization 

P^*(X|S) = n^(^^-|S) (19) 

j 

with 

P(a;,|S)=C(m) <5(x, + $) + [1 - C (A)] S{x,-1). 

(20) 

Here, m ^ m(S) = {m\S) , . . . , m'^ (S)) is the 
Af -dimensional overlap vector, and C {m) stands 
for a function of lii to be determined. The de- 
pression effect here depends on the overlap vec- 
tor which measures the net current arriving to 
postsynaptic neurons. The non-local choice H19|l - 
(|20|l thus introduces non-trivial correlations be- 
tween synaptic noise and neural activity, which 
is not considered in H17() . Note that, therefore, 
we are not modelling here the synaptic depres- 
sion dynamics in an explicity way as, for instance, 
in [Tsodyks et al., 1998[ . Instead, equation ipHjl 
amounts to consider fast synaptic noise which nat- 
urally depresses the strengh of the synapses after 
repeated activity, namely, for a high value of ( (m) . 

Several further comments on the significance of 
p9|l - H20(l . which is here a main hypothesis together 
with p — > 0, are in order. We first mention that 
the system time relaxation is typically orders of 
magnitude larger than the time scale for the var- 
ious synaptic fiuctuations reported to account for 
the observed high variability in the postsynaptic 
response of central neurons [Zador, 1998[ . On the 
other hand, these fluctuations seem to have differ- 
ent sources such as, for instance, the stochasticity 



5 



of the opening and closing of the vesicles (S. Kil- 
fiker, private communication), the stochasticity of 
the postsynaptic receptor, which has its own several 
causes, variations of the glutamate concentration in 
the synaptic cleft, and differences in the potency re- 
leased from different locations on the active zone of 
the synapses [Franks et al., 2003| . Is this complex 
situation the one that we try to capture by intro- 
ducing the stochastic variable x in Q and subse- 
quent equations. It may be further noticed that 
the nature of this variable, which is "microscopic" 
here, differs from the one in the case of familiar 
phenomenological models. These often involve a 
"mesoscopic" variable, such as the mean fraction 
of neurotransmitter, which results in a determinis- 
tic situation, as in [Tsodyks et al., 1998| . The de- 
pression in our model rather naturally follows from 
the coupling between the synaptic "noise" and the 
neurons dynamics via the overlap functions. The 
final result is also deterministic for p — > but only, 
as one should perhaps expect, on the time scale 
for the neurons. Finally, concerning also the real- 
ity of the model, it should be clear that we are 
restricting ourselves here to fully connected net- 
works just for simplicity. However, we already stud- 
ied similar systems with more realistic topologies 
such as scale- free, small- world and diluted networks 
[Torres et al., 2004| , which suggests one to general- 
ize the present study in this sense. 

It is to be remarked that our case H19() - (|20|l also 
reduces to the Hopfield model but only in the limit 
$ ^ — 1 for any ( (m) . Otherwise, the competition 
results in a rather complex behavior. In particular, 
the noise distribution P*''(X|S) lacks with (j^UJ) the 
factorization property which is required to have an 
effective Hamiltonian with proper symmetry. Nev- 
ertheless, we may still write 

C[S ^ S*] _ y-r / dXj P{x.j |S) '^{SiXjSjPij) 

(21) 

Then, using (|2()|l . we linearize around Wij — 0, 
i.e., Pij = for T > 0. This is a good approxi- 
mation for the Hebbian learning rule [Hebb, 1949[ 
Wij = Si/^i^Cj ' which is the one we use here- 
after, as far as this rule only stores completely un- 
correlated, random patterns. In fact, fluctuations 
in this case are of order \/M /N for finite M (or 
order I/VTV for finite a) which tends to vanish for 
a sufficiently large system, e.g., in the macroscopic 
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Figure 1: The steady overlap m{T), as predicted by equa- 
tion 1251 . for different values of the noise parameter, namely, 
<!> = -2.0, -1.5, -1.0, -0.5, 0, 0.5, 1.0, 1.5, 2.0, from top 
to bottom, respectively. (<& = — 1 corresponds to the Hop- 
field case, as explained in the main text.) The graphs depict 
second order phase transitions (solid curves) and, for the 
most negative values of first order phase transitions (the 
discontinuities in these cases are indicated by dashed lines). 
The symbols stand for Monte Carlo data corresponding to a 
network with N = 1600 neurons for <3> = —0.5 (filled squares) 
and —2.0 (filled circles). 

(thermodynamic) limit N — > oo. It then follows the 
effective weights: 

< = {l-^^[C(m) + C(m')]}^».' (22) 

where m = m(S), m' = m(S') — m— 2si^i/iV, and 
= ,£,f , is the binary M-dimensional 

stored pattern. This shows how the noise modifies 
synaptic intensities. The associated effective local 
fields are 

hf^Y.<f'r (23) 

The condition to obtain a true effective Hamilto- 
nian, i.e., proper symmetry of (|22|l from this, is 
that m' = m — 2si^i/N ~ m. This is a good ap- 
proximation in the thermodynamic limit, N ^ oo. 

Otherwise, one may proceed with the dynamic 
equation (|f 6|l after substituting (|23|l . even though 
this is not then a true effective Hamiltonian. One 
may follow the same procedure for the Hopfield case 
with asymmetric synapses [Hertz et al., 1991], for 
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Figure 2: Phase diagram depicting the transition temper- 
ature Tc as a function of T and The solid (dashed) curve 
corresponds to a second (first) order phase transition. The 
tricritical point is at (Tc,<3?c) = (1,-4/3). Fand P stand 
for the ferromagnetic-like and paramagnetic-like phases, re- 
spectively. The best retrieval properties of our model system 
occur close to the left— lower quarter of the graph. 

instance. Further interest on the concept of local 
effective fields as defined in section Ol follows from 
the fact that one may use quantities such as l|23|l 
to importantly simplify a computer simulation, as 
it is made below. 

To proceed further, we need to determine the 
probability C, in 120(1 . In order to model activity- 
dependent mechanisms acting on the synapses, 
C should be an increasing function of the net presy- 
naptic current or field. In fact, C (m) simply needs 
to depend on the overlaps, besides to preserve the 
±1 symmetry. A simple choice with these require- 
ments is 



C(m) 



1 



■E 



m"^ (S) 



(24) 



where a = M/N. We describe next the behavior 
that ensues from H22() - (|24|) as implied by the noise 
distribution 



5 Noise induced phase transi- 
tions 

Let us first study the retrieval process in a sys- 
tem with a single stored pattern, M = 1, when the 
neurons are acted on by the local fields (|23|l . One 



to 

E 




0.5 

m 



Figure 3: The function F as defined in l28l for (5 = and, 
from top to bottom, <I> = —2, —1, 0, 1 and 2. The solution of 
1271 becomes unstable so that the activity will escape the 
attractor (m = 1) for _F < 0, which occurs for <& > in this 
case. 

obtains from H14|l - (|16|) . after using the simplifying 
(mean-field) assumption (s^) w Si that the steady 
solution corresponds to the overlap: 

TO = tanh{T-^m[l-(m)2(l + $)]}, (25) 

TO = m'^^^, which preserves the symmetry ±1. Lo- 
cal stability of the solutions of this equation re- 
quires that 



TO > TOclJ ) = —pz — — 



(26) 



The behavior H25() is illustrated in figuren]for sev- 
eral values of $. This indicates a transition from a 
ferromagnetic-like phase, i.e., solutions to with 
associative memory, to a paramagnetic-like phase, 
TO = 0. The transition is continuous or second or- 
der only for <I> > <I>c = —4/3, and it then follows 
a critical temperature Tc — I. Figure El shows the 
tricritical point at (Tc, ^c) and the general depen- 
dence of the transition temperature with $. 

It is to be remarked that a discontinuous phase 
transition allows for a much better performance of 
the retrieval process than a continuous one. This is 
because the behavior is sharp just below the transi- 
tion temperature in the former case. Consequently, 
the above indicates that our model performs better 
for large negative <I>, <f> < —4/3. 

We also performed Monte Carlo simulations. 
These concern a network of = 1600 neurons 
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Figure 4: Time evolution of the overlap, as defined in 1151 . 
between the current state and the stored pattern in Monte 
Carlo simulations with 3600 neurons at T = 0.1. Each graph, 
for a given set of values for {S, <&) shows different curves cor- 
responding to evolutions starting with different initial states. 
The two top graphs are for 5 = 0.3 and <I> = 1 (graphs A and 
C) and <I> = —1 (graphs B and D), the latter corresponding 
to the Hopfield case lacking the fast noise. This shows the 
important effect noise has on the network sensitivity to ex- 
ternal stimuli. The two bottom graphs illustrate the same 
for a fixed initial distance from the attractor as one varies 
the external stimulation, namely, for 5 = 0.1, 0.2, 0.3, 0.4 and 
0.5 from top to bottom. 



Figure 5: Time evolution during a Monte Carlo simulation 
with N = 400 neurons, M = 3 correlated patterns (as de- 
fined in the main text), and T = 0.1. The system in this case 
was let to relaxe to the steady sate, and then perturbed by 
the stimulus —S^", S = 0.3, with v = 1 for a short time in- 
terval, and then with v = 2, and so on. After suppresing the 
stimulus, the system is again allowed to relaxe. The graphs 
show as a function of time, from top to bottom, (i) the num- 
ber of the pattern which is used as the stimulus at each time 
interval; (ii) the resulting response of the network, measured 
as the overlap of the current state with pattern i' = 1, in the 
absence of noise, i.e., the Hopfield case <I> = — 1; (iii) the 
same for the relevant noisy case <J> = 1. 



acted on by the local fields (|2H|I and evolving by 
sequential updating via the effective rate (|14|l . Ex- 
cept for some finite-size effects, figure H shows a 
good agreement between our simulations and the 
equations here; in fact, the computer simulations 
also correspond to a mean-field description given 
that the fields ^ assume fully connected neurons. 

6 Sensitivity to the stimulus 

As shown above, a noise distribution such as 1)20(1 
may model activity-dependent processes reminis- 
cent of short-time synaptic depression. In this sec- 
tion, we study the consequences of this type of 
fast noise on the retrieval dynamics under exter- 
nal stimulation. More specifically, our aim is to 
check the resulting sensitivity of the network to ex- 
ternal inputs. A high degree of sensibility will fa- 
cilitate the response to changing stimuli. This is an 



important feature of neurobiological systems which 
continuously adapt and quickly respond to varying 
stimuli from the environment. 

Consider first the case of one stored pattern, 
M = 1. A simple external input may be simu- 
lated by adding to each local field a driving term 
-(5^j, Vi, with < (5 < 1 [Bibitchkov et al., 2002| . 
A negative drive in this case of a single pattern as- 
sures that the network activity may go from the 
attractor, ^, to the "antipattern" , — ^. It then fol- 
lows the stationary overlap: 

m = tanh[T"ii^(TO,$,(5)] (27) 

with 

F(m,$,(5) = TO[l-(m)2(l + $)-^]. (28) 

Figure 13 shows this function for (5 = and vary- 
ing $. This illustrates two different types of behav- 
ior, namely, (local) stability {F > 0) and instabil- 
ity {F < 0) of the attractor, which corresponds to 
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m = 1. That is, the noise induces instabihty, result- 
ing in this case in switching between the pattern 
and the antipattern. This is confirmed in figure^ 
by Monte Carlo simulations. 

The simulations corresponds to a network of TV = 
3600 neurons with one stored pattern, M = 1. This 
evolves from different initial states, corresponding 
to different distances to the attractor, under an ex- 
ternal stimulus — (S^^ for different values of S. The 
two left graphs in figure 01 show several indepen- 
dent time evolutions for the model with fast noise, 
namely, for $ = 1; the two graphs to the right are 
for the Hopfield case lacking the noise ($ = —1). 
These, and similar graphs one may obtain for other 
parameter values, clearly demonstrate how the net- 
work sensitivity to a simple external stimulus is 
qualitatively enhanced by adding presynaptic noise 
to the system. 

Figures [S] and illustrate a similar behavior in 
Monte Carlo simulations with several stored pat- 
terns. Figure El is for M = 3 correlated patterns 
with mutual overlaps |m'''''| ee \l/N = 
1/3 and = 1/3. More specifically, each pat- 

tern consits of three equal initially white (silent 
neurons) horizontal stripes, with one of them black 
colored (firing neurons) located in a different posi- 
tion for each pattern. The system in this case be- 
gins with the first pattern as initial condition and, 
to avoid dependence on this choice, it is let to re- 
lax for 3x10'* Monte Carlo steps (MCS). It is then 
perturbed by a drive — 5^'', where the stimulus 
changes {v = 1,2,3,1,...) every 6x10^ MCS. The 
top graph shows the network response in the Hop- 
field case. There is no visible structure of this signal 
in the absence of fast noise as far as ^ ^ 1. As a 
matter of fact, the depth of the basins of attraction 
are large enough in the Hopfield model, to prevent 
any move for small S, except when approaching a 
critical point (Tc — I), where fluctuations diverge. 
The bottom graph depicts a qualitatively different 
situation for $ = 1. That is, adding fast noise in 
general destabilizes the fixed point for the interest- 
ing case of small d far from criticality. 

Figure|n|confirms the above for uncorrelated pat- 
terns, e.g. to'^'^ « (5"^'^ and (^f ) « 0. That is, this 
shows the response of the network in a similar sim- 
ulation with 400 neurons at T = 0.1 for M — 3 
random, othogonal patterns. The initial condition 
is again i> — 1, and the stimulus is here +5(^'^ with 
v changing every 1, 5x10^ MCS. Thus, we conclude 
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Fi gure 6; The same as in figure |^ but for three stored 
patterns that are orthogonal (instead of correlated). The 
stimulus is -t-iS^", 5 = 0.1, with u = u (t) , as indicated at 
the top. The time evolution of the overlap m'^ is drawn 
with a different color (black, dark-grey and light-grey, re- 
spectively) for each value of p to illustrate that the system 
keeps jumping between the patterns in this case. 

that the switching phenomena is robust with re- 
spect to the type of pattern stored. 

7 Conclusion 

The set of equations iQJ-lO provides a general 
framework to model activity-dependent processes. 
Motivated by the behavior of neurobiological sys- 
tems, we adapted this to study the consequences 
of fast noise acting on the synapses of an attrac- 
tor neural network with a finite number of stored 
patterns. We present in this paper two differ- 
ent scenarios corresponding to noise distributions 
fulfilling jnj and (|19|l . respectively. In particu- 
lar, assuming a local dependence on activity as 
in (|17|l . one obtains the local fields H18(l . while a 
global dependence as in 12()|l leads to (|23(l . Un- 
der certain assumptions, the system in the first of 
these cases is described by the effective Hamilto- 
nian ||SJ). This reduces to a Hopfield system — i.e., 
the familiar attractor neural network without any 
synaptic noise — with rescaled temperature and a 
threshold. This was already studied for a Gaus- 
sian distribution of th resholds [ Hertz et al., 1991[ 
[Horn and Usher, 1989| |Litinskii, 2002^ Concern- 
ing stationary properties, this case is also similar to 
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the one in IBibitchkov at al., 2002| . A more intrigu- 
ing behavior ensues when the noise depends on the 
total presynaptic current arriving to the postsynap- 
tic neuron. We studied this case both analytically, 
by using a mean-field hypothesis, and numerically 
by a series of Monte Carlo simulations using single- 
neuron dynamics. The two approaches are fully 
consistent with and complement each other. 

Our model involves two main parameters. One 
is the temperature T which controls the stochastic 
evolution of the network activity. The other pa- 
rameter, controls the depressing noise intensity. 
Varying this, the system describes from normal op- 
eration to depression phenomena. A main result is 
that the presynaptic noise induces the occurrence of 
a tricritical point for certain values of these param- 
eters, (Tc,<i>c) = (1,-4/3). This separates (in the 
limit a — > 0) first from second order phase transi- 
tions between a retrieval phase and a non-retrieval 
phase. 

The principal conclusion in this paper is that 
fast presynaptic noise may induce a nonequilib- 
rium condition which results in an important in- 
tensification of the network sensitivity to exter- 
nal stimulation. We explicitly show that the noise 
may turn unstable the attractor or fixed point 
solution of the retrieval process, and the system 
then seeks for another attractor. In particular, 
one observes switching from the stored pattern to 
the corresponding antipattern for M = 1, and 
switching between patterns for a larger number 
of stored patterns, M. This behavior is most in- 
teresting because it improves the network ability 
to detect changing stimuli from the environment. 
We observe the switching to be very sensitive to 
the forcing stimulus, but rather independent of 
the network initial state or the thermal noise. It 
seems sensible to argue that, besides recognition, 
the processes of class identification and catego- 
rization in nature might follow a similar strategy. 
That is, different attractors may correspond to dif- 
ferent objects, and a dynamics conveniently per- 
turbed by fast noise may keep visiting the attrac- 
tors belonging to a class which is characterized by 
a certain degree of correlation between its elements 
[Cortes et al., 2005| . In fact, a similar mechanism 
seems at the basis of early olfactory processing 
of insects [Laurent et al., 2001| , and instabilities of 
the same sort have been described in the cortical 
activity of monkeys [Abeles et al., 1995] and other 



er am 



remer 



, 20001 . 



cases 

Finally, we mention that the above complex 
behavior seems confirmed by preliminary Monte 
Carlo simulations for a macroscopic number of 
stored patterns, i.e., a finite loading parameter a — 
M/N 0. On the other hand, a mean-field approx- 
imation (see below) shows that the storage capacity 
of the network is ac = 0.138, as in the Hopfield case 
|Amit et al., 1987| , for any $ < 0, while it is always 
smaller for $ > 0. This is in agreement with previ- 
ous results concerning the effect of synaptic depres- 
sion in Hopfield-like systems [Torres et al., 20021 
[Bibitchkov et al., 2002[ . The fact that a positive 
value of $ tends to shallow the basin thus destabi- 
lizing the attractor may be understood by a sim- 
ple (mean-field) argument which is confirmed by 
Monte Carlo simulations [Cortes et al., 2005) . As- 
sume that the stationary activity shows just one 
overlap of order unity. This corresponds to the con- 
densed pattern; the overlaps with the rest, Af — 1 
stored patterns is of order of {non-condensed 
patterns) [Hertz et al., 1991] . The resulting prob- 
ability of change of the synaptic intensity, namely, 
(1 + a) ^^^lim'^y is of order unity, and the local 

fields (123) follow as hf $/if°P^°''^. Therefore, 

the storage capacity, which is computed at T = 0, 
is the same as in the Hopfield case for any $ < 0, 
and always lower otherwise. 
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